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INTRODUCTION 



The decision of wliat, liow and to wliom to communicate any test results is a very 
individualistic determination (see Nations Schools, April 1972). The superintendent who, along 
with the staff, receives a number of Educational Quality Assessment reports Is faced with an 
added dilemma because of the length and complexity of each report. 

The one decision the superintendent need no longer make is whether to release the 
information to relevant pubUcs-the school board, faculties, community, and students. The 
resolution passed In March 1974 by the State Board of Education reaffirms the principle of 
community involvement in the development of the long-range plans which must be submitted 
by each school district. Since the plan must be based upon the findings of EQA, it will be difficult 
to meet both these criteria without sharing those same EQA results with that community. Basic 
Education Circular 80 (see Appendix) relates to department policy on release of EQA results. 

For the first three years of voluntary participation by school districts in EQA, the 
Pennsylvania Department of Education left to each superintendent the discretion of sharing the 
results. Some may view this a dereliction of duties, others as a healthy hands-off policy by the 
PDE. But, as long as districts were volunteering for the assessment, it would have been somewhat 
unfair to require a participating district to release its results while the adjoining district had declined 
even to volunteer. 

This departmental policy, while not without either its merits or faults, resulted in many 
districts making the easy decision to do nothing about informing any of its publics of the 
results of that four hours of testing its students had undergone. 

Many others, from 1970-73, have used diverse and imaginative means of sharing the results. 
An EQA follow-up questionnaire surveyed those 238 districts to see how, what and to whom 
results were communicated. Many of the ideas cited herein are based upon replies and samples 
of dissemination materials used by these districts. 

, The biggest obstacle to communication has been the uneasiness administrators have felt in 
grasping and understanding the complex report. Indeed, those districts that have done the most 
with the report are those where someone on the staff-an assistant superintendent, curriculum 
director, or even the superintendent-has taken the time to fully understand the report. Only 
when someone feels comfortable and competent enougli to tell one's colleagues what is in the 
reports can sharing the results be successful. Nothing can be more disastrous or a waste of time 
than the person who stands in front of a faculty, say, and misinforms them or is unable to 
answer the first question posed. When this expert can't answer the query, the questioner may 
conclude that there is no satisfactory answer and leave with negative feeHngs about EQA. EQA'.s 
harshest critics are almost always those least informed or misinformed. 

Generalizations on how to share results are next to impossible. For example, the one-school 
district (with only three reports, one each for its 5th, 8th and 1 1th grades) will use an approach 
quite different from the district with 20 schools. 

Following is a case study of a hypothetical Upper Penn School District with five elementary 
schools, two junior highs and a senior high which received eight EQA reports. The presentations 
are suggestive, not prescriptive. 

Publicity can be classified many ways. The scheme used here suggests what a school district 
might do in the way of preassessment publicity, concurrent pubHcity, and postassessment publicity. 
The emphasis is on the last of these as communicating the assessment results is the most challenging 
task. 



PREASSESSMENT PUBLICITY 



Introduction 



Many school personnel use some means to publicize their participation in the assessment 
program prior to the actual testing of students. This may be through a press release, district 
newsletter, faculty bulletin, etc. Or one may communicate similar information orally at meetings 
- of the school board, faculty, PTA, or civic groups such as the League of Women Voters or Kiwanis 

Club. 

Some people feel preassessment publicity will only cause problems. Others have made 
commitments to parents and faculty to inform them beforehand of any testing. 

There are two principles which should be emphasized and remembered at all times: 

(1) Students are never identified by name. Their replies are not only confidential but also 
anonymous. Students remove their names from their answer sheets before turning them 
in. No one anywhere, in the school or in Harrisburg, has any way of knowing who 
said what. They know only, and then only collectively, what the students said. 

This policy avoids attaching insidious labels to students to be used locally or stored 
in some Big Brother computer data bank. It further is designed to encourage honest 
replies on the part of the students so they do not feel compelled to give the right 
answer and play the game of guess what they want to hear. 

(2) The assessment program is a legislative mandate, directed by the State Board of 
Education, and administered by the Department of Education. (Forty-eight states have 
some kind of assessment or accountability legislation now on their books. And national 
assessment, funded by the federal government, asks similar questions of the sampled 
students although no data are returned to the school). 



Some irate citizens who write their legislators or threaten a Congressional 
investigation seem to think the department or the school is doing something behind 
the legislature's back. They may still disagree with the concept (although few do when 
they are in possession of all the facts) but at least they should know how and why 
assessment came about and what it purports to do. 

Following are two articles-Sample Release A and Sample Release B that could 
be used to announce a district's participation in EQA. A few words, in brackets, might 
be either omitted or simplified after considering the sophistication of the intended 
audience. 
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SAMPLE RELEASE A 



UPPER PENN SCHOOLS TO PARTICIPATE IN STATE ASSESSMENT PROGRAM 

In March of this school year Upper Penn Schools will be participating in the Educational 
Qudity Assessment program administered by the Pennsylvania Department of Education. 

What is quality education? When is a school good? When more students go on to college? 
When it spends more money? When it has a championship football team? Or, is it good when 
thu school officials say it is? 

Until recently there have been few methods for measuiing the quality of any given school. 
To remedy this situation, the Pennsylvania Legislature devised an objective and systematic means 
of evaluating education in the Commonwealth called the Pennsylvania Educational Quality 
Assessment Program. The program coordinator developed a survey based on Pennsylvania's Ten 
Goals of Quality Education. The 10 goals urge schools to place a high priority on their students* 
personal and social growth as well as their intellectual growth. 

It should be noted that Pennsylvania's plan for assessment is unique. Although the program 
is now mandatory, participation was on a voluntary basis for the first three years. It seems that 
school officials as well as the public are anxious to receive objective information about their 
schools, their students and their teachers. Past surveys have provided officials of 300 of the state's 
505 school districts with valuable information. By a resolution of the State Board of Education, 
one-third of the schools in the state are being assessed in each of three years, 1974, 1975 and 
1976. 

Upper Penn is one of 170 districts which will receive reports for their 1,200-some schools 
this October. Over 160,000 5th, 8th and 11th grade students around the Commonwealth will 
be completing questionnaires during the first two weeks of March. 

The Assessment Provides Information 

The assessment is not a device to standardize the curriculum ?s specific su,bject matter plays 
a minor role in the survey. It does give schools information about what their students know 
and feel, their teachers' perception of the school and community, and how these attitudes compare 
to those in schools throughout the Commoawealth. The key word is information-value judgments 
are left to the local school officials. More specifically, the survey considers the attitudes, values, 
beliefs, habits and basic cognitive skills thought to be important in the development of our children. 
Students do not put their names on their answer sheets so there is no record of how any individual 
answered the questions. 

Teachers also respond to a questionnaire concerning classroom practices, teacher experience, 
community conditions and other variables. All of the information received is combined v/ith 
additional background information on file in the state Department of Education to form the 
school report. A report will be compiled for each school to give us objective information about 
how our schools compare to others throughout the state and, moreover, to other schools that 
are similar to ours. Such hard data are necessary to combat the folklore and testimonial aspect 
of the usual assurances that one has a good school. 
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SAMPLE RELEASE B 
Upper Penn Schools to be Assessed by State 



In Marcli of this school year, Upper Penn Schools will be participating in the Educational 
Quality Assessment program administered by the Pennsylvania Department of lulucation. Students 
in grades 5, 8 and 1 1 will be completing questionnaires to obtain information on student skills 
and attitudes on the Ten Goals of Quality Education, These goals, adopted in 1%5 by the State 
Board of Hducation, underscore the role of the school in develo| aig the whole child. Basic skills 
tests are included as well as attitudinal measures which give information about the students' interest 
in school, citizenship, health habits, creativity, etc. 

Students are not identified by name; in fact, they will remove their names from their answer 
sheets before turning them in to be mailed and scored. This [anonymity Jis particuhirly important 
when asking attitudinal questions so that a student will luiswer honestly and not feel compelled 
to give the socially desirable answer. Moveover, no [insidious] labels can be attached to students 
and made a part of their permanent record. No one anywhere will know how a given student 
replies to any item. 

All data will be aggr gated for each school to give information regarding both absolute and 
relative student performance on the 10 goals. We will find out how our schools fare compared 
to all other schools in the state; in addition, we will discover how our schools* scores compare 
to schools with a similar mix of operating conditions. 

To find out what those conditions are, [socioeconomic] data (occupational and educational 
levels of parents) must be obtained from the students-but again aggregated for the school. A 
questionnaire, to be filled out by teachers, adds further to this background information to complete 
the school's profile. Thus, the school obtains in return not only where it is scoring but also 
where one might reasonably expect it to score with the resources at its disposal. 

The state assessment program, although operational since 1970, is now in the second year 
of a 1974, 1975, 1976 cycle. In the spring of each year, one-third of the schools in the state 
are assessed in keeping with the legislative mandate that a uniform evaluation procedure be 
developed to obtain objective data about the schools. Upper Penn is one of 170 districts which 
will be receiving reports for their more than 1,200 schools next fall. In excess of 160,000 students 
around the Commonwealth will be completing the Pennsylvania Student Questionnaire during 
the first two weeks of March. 

Educational Quality Assessment won*t answer all the questions about Upper Penn Schools. 
It may even raise some. But, it will give us an important tool for seeing how Upper Penn compares 
to other schools throughout the state and an unparalleled vantage point to see what we are doing 
for students in the affective as well as the cognitive areas. 
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CONCURRENT PUBLICITY 



Introduction 



Publicity prior to or during tlie actual administration of the questionnaires is a matter which, 
like all others, must be locally determined based upon a knowledge of the community. For 
example, at the regional workshops designed to coordinate the statewide administration, a sample 
letter was made available for elementary schools to send home with students to obtain the father's 
occupation and mother's educational levels when such data are not available on school records. 
EQA staff were not recommending the letter, just making it available; in fact, they were issuing 
a warning that those using it should carefully consider the possible repercussions. Some district 
representatives concluded that they might better avoid sending a letter; others stated that their 
commitments to parents mandated prior notification even that testing was taking place. 

Two sample letters, A and B, notifying parents and requesting father's occupation and mother's 
education levels follow. 

In addition to the general information regarding the assessment program, Sample C illustrates 
a statement to be read to teachers prior to requesting them to complete the teacher questionnaire. 
Sample D could be read to students prior to their completing the student questionnaire. 
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SAMPLE A 



February 22, 197^ 
Deiir Piirent: 

Upper Penn School District is scheduled to participate in the Pennsylvania Educational Quality 
Assessment Program during the week of March 4, 197^. Students enrolled in the 5th, 8th and 
11th grades will be involved. 

The assessment is not a test in the usual sense. 

Primarily, it is a set of questionnaires designed to describe attitudes and knowledge possessed 
by students as a group at the grade level for each school. 

The assessment will provide information related to the Ten Goals of Quality Education established 
by the Pennsylvania State Board of Education. The results of the assessment will be reported 
back to schools where they can be analyzed and interpreted for purposes of clarifying, evaluating 
and improving educational programs in local schools. 

The reporting system used by the state permits the actual outcomes to be compared with predicted 
outcomes for each school. To assist in determining predicted outcomes the state Department 
of Education, Division of Educational Quality Assessment, must have information from parents 
of 5th grade students as requested on the enclosed form. Please complete and retuim this form 
to the homeroom teacher by March 1, 197_, in the envelope provided. This same information 
will be provided to the test bureau by 8th and 11th grade students as a part of the student 
questionnaire. Needless to say, the responses are confidential and all reports will be anonymous. 

If you have questions, please contact your principal. Your cooperation is appreciated. 

Sincerely, 



John J. Doe 

Superintendent of Schools 
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SAMPLE A (continued) 



Educational Quality Assessment Information 
for tlie Pennsylvania Department of Education 



February 22, 197_ 



Pupil's Name 



MOTHER OR FEMALE GUARDL\N 

From the list of educational levels below circle the number which represents the highest educational 
level reached. 

1. None or some grade school 

2. Completed grade school 

3. Some high school but not a graduate 

4. High school graduate 

5. Some college, vocational* technical, business school after high school 

6. Bachelor's degree 

7. Master's degree 

8. Some work toward a Ph.D. or professional degree 

9. Ph.D. or professional degree 

FATHER OR MALE GUARDL\N 

What is your occupation? 

Thanic you for your cooperation. 
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SAMPLE B 



Dear Parent: 

In an attempt to identify the strengths and weaknesses of our schools' programs, Upper 
Penn School District Is participating in the Pennsylvania Department of Edncation's Quality 
Assessment Program. The program measures student performance in many areas-such as basic 
skills, self-esteem, citizenship, health habits. To make statewide comparisons, the state department 
needs information about the community and its parents. 

Our records contain most of the requested information, but we need two additional items 
to complete the questionnaire. 

To supply the missing data, would you please complete the form below and return it to 
the school by March 8, 197__. 



Student's name . 

Highest level of education attained by student's mother or female guardian 



Occupation of student's father or male guardian 
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SAMPLE C 



Our school is taking part in the Educational Quality Assessment Program of the Pennsylvania 
Department of Education. The results of the program will aid our staff in making decisions about 
our school s programs in the future. Our students will fill out a questionnaire which will indicate 
their performance on each of tlie Ten Goals of Quality Education. This performance will be 
compared to the performance of students in other schools in Pennsylvania. Also, the student 
performance will be compared to that of schools with similar conditiors, such as instructional 
expense per pupil, size, parental attitudes. Some of these conditions involve teachers. I am 
distnbuting a brief questionnaire which you should fill out frankly and honestly. You will notice 
that you must fill out the district name and school name, but there is no individual identification. 
Alter the questionnaires are completed, they will be scrambled as they are collected and placed 
in an envelope which will be sealed and placed with the student materials to be mailed to the 
scoring firm. This does not allow anyone to identify any individual and will permit you to answer 
freely. The information returned to the district will be on a group ba.sis. The value of this service 
program depends on your candid, honest answers. 



Eleventh grade students of Upper Penn School District have been selected to take part in 
an important project for the school district in cooperation with the Pennsylvania Department 
of Educatioii. 

The questionnaires which you will complete are designed to assess your thoughts and feelings 
about yourselves and the worid you live in. In addition to the usual mathematics and verbal 
tests you are accustomed to taking, you will be asked questions about how you feel about school, 
about yourself and about others. There will be items about health, sports, art and music. 

Thw answers you give will in no way affect your school grades. Your answer sheet will 
be read by machine. In fact, you will remove your name from the answer sheet when you have 
finished with it. Your individual responses will be kept in the strictest confidence and will not 
be returned to you or to your school. 

You can help to make this program a success by being very honest when answering those 
questions which ask your opinions. For those questions which ask for facts, answer to the best 
of your knowledge. 

Through these questionnaires we hope that we can better come to grips with the concerns 
of young adults and students. Hopefully, with better knowledge of your concerns we can: (a) 
narrow the gulf between student and teacher; (b) create new atmospheres of learning where there 
)s a free exchange of ideas and attitudes, as well as skills, essential for our school to produce 
citizens prepared to learn and cope with all the skills of life. 



SAMPLE D 
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POSTASSESSMENT PUBLICITY 



Introduction 



Releasing, discussing and using the results of the assessment reports must occur on at least 
two levels-the district and the school-and to three or four kinds of audiences including the school 
board, the community, and the faculties of the schools. 

The two biggest obstacles in sharing results seem to be: 

1. How to communicate negative results. 

2. How to communicate such a great quantity of information. 

The first problem can never be underestimated, but clues from previous districts suggest 
that negative results are ameliorated when the presenter identifies X as an area of weakness 
uncovered by EQA and here is what we are doing about it. In other words, most reasonable 
people react favorably to a conscientious action by school officials who acknowledge they are 
less than perfect and further state what actions they have taken to remedy the situation. 

Other times negative results are a confirmation of what school officials have been saying 
uU along. Such consensual validation gleaned from the reports qan provide added support to 
previously unheeded request for funds, programs or personnel. 

Specificity and Detail Can Vary 

Without hiding information, one can be less specific in communicating results than were 
the reports. Exhibit C solves this problem by reporting district scores by quartiles rather than 
percentiles. (One could just as well use qulntiles, deciles, stanines or any other means of 
standardizing scores). This is a perfectly honest, legitimate reporting procedure, particularly when 
the audience will read undue significance to one school's being at the 14th percentile and another's 
being at the 21st. It can also minimize the pitting of one school against another, which is not 
the purpose of the assessment. The purpose is to give decision-makers information about their 
schools. 

The second problem, that of how to communicate the great quantity of information included 
in the reports, is the real purpose of this document. The overriding principle one must master 
is that not every number in every report can or must be communicated to every audience. There 
is no doubt that one of the strengths of the report is its thorou^ness and many feel any abridgment 
will weaken it. But a central office administrator, or whoever is charged with the task, must 
face the fact that the potential audiences, being statistically less sophisticated, may not comprehend 
(and worse may misunderstand) all the information. The presenter must also face the fact that 
every audience may not be all that interested in the total school picture that the report presents. 
Many teachers, particularly at the secondary level, whether by training or inclination, take a narrow 
view of their role: My job is to teach physics, not citizenship. To the extent such attitudes 
exist, individual teachers may be less fascinated with the report than their principal. 
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Releases Should Be Coordinated 



Timing deserves some mention. In the past, some districts have shared results with the school 
board but not informed the faculties. When questioned, teachers were ignorant (What assessment 
report?) and resented being left in the dark. The reverse can equally be true. In one district, 
a faculty member, married to a board member, took home a handout which the board had not 
yet seen. All audiences should be informed as close to the same time as possible. When one 
audience gets results, in effect, the others do too-at least Indirectly. 

Such sharing, needless to say, underscores the necessity of being forthright, sharing the good 
and tlie bad, and not playing one audience against another. One cannot, for example, select all 
the positive results to present to the board and select all the negative tlndings to use as a weapon 
against a taculty or a teachers' association. 

One other timing factor to consider is what nearby districts are doing. If a neighboring 
district issues a press release and you have not yet considered a plan of action, you are in an 
inenviable position. 

Methods of Presentation 

No single medium need be employed to present results. Both written reports and charts 
have their limitations. They can be supplemented by oral presentations using charts or 
transparencies for overhead projectors. 

The group must be allowed to ask questions. One-way communication is disastrous. The 
audience will undoubtedly want and need clarifications. The presenter likewise needs this feedback 
to assess his or her own success in communicating and avoiding, or at least minimizing, 
misunderstandings. 

All the suggestions which follow are based upon the data included in the school report 
and information and charts from the interpretation manual. Additionally, many school officials 
have accepted the invitation to come to the department to obtain item data for one or two 
goals for their schools. These include the percentage of students who gave each reply to a given 
item. Because of tlieir specificity, many people find this information easier to identify with than 
some of the abstractions represented by total or even^subscale scores. They are not included 
in the school report because item data for some 400 questions would make an already complex 
report overwhelming. Because they are not part of the school report, the exhibits which follow 
assume no possession of such data by Upper Penn school officials. 

The following exhibits suggest kinds of information one might communicate. Extensive use 
has been made of charts and tables from the interpretation manual. It is not copyrighted. So 
feel free to copy it] Or pull out sections of the EQA publication The First Six Years. Use your 
imagination. Most of the enclosures are composite plagiarizations-selections of what some school 
somewhere has used to share results. 

Six Samples of Sharing Results 

Each exhibit was designed differently. An explanation of possible uses follows; 
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Exhibit A 



This report of district results could be used as a press release or a narrative report to the 
school board prior to a presentation by one of the school officials. Or it could be included 
as part of a district newsletter. 

1. It starts off with a specific and positive district-wide finding. 

2. It shows how and when Upper Penn was involved. 

3. It includes the 10 goals-in narrative form and in a listing to be placed in box or banner 
for a news article. 

4. It states purpose of assessment. 

5. It emphasizes importance of anonymous replies. 

6. It states history of EQA. 

7. It tells kinds of information provided in the report. 

8. It returns to Upper Penn's results, repeating the positive results from the first paragraph. 

9. It addresses itself to the math problem area and the action taken to date to remedy 
the problem. 

10. It shows that responsibility for action is at the local level. 
Exliibit B 

This is designed to be used as a handout at a school board meeting. 

1. Includes complete statement of the 10 goals. 

2. Includes description of the areas measured by each goal instrument (test, inventory, 
questionnaire). 

3. Includes district results for each school-percentile rank by goal and whether score was 
in expectation band. 

Here the schools are identified by number only. One district reported using this procedure 
at a public board meeting. The overall meeting then was divided into eight separate meetings 
where parents saw the results in more detail for their school. This procedure minimized interschool 
comparisons at the public meeting but still allowed parents to see the results for the school 
which serves their area. 

Exhibit C 

Purpose is the same as Exhibit B and this page could substitute for percentile scores for 
each elementary school. This procedure emphasizes needs by program areas rather than by school. 
Only the elementary schools are so grouped here, but the three secondary schools could be added, 
or put in the same format for a secondary schools report. 

SUght modification here would allow the schools to be identified by quartile-that is, which 
school was in the bottom quartile on Goal I rather than how many schools (in this case, one) 
were in each quartile. 

Exhibit D 

This is a detailed report for one school in the district which could be used as a handout 
before or as part of an in-service day or faculty meeting. It is more detailed because it tries 
to communicate almost all the information in the school report-but in a different, hopefully 
more readable and understandable fofnat. Highlights include: 

1. General background information on mechanics of assessment and kind of data provided 
in report. 
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2. Percentile rank by goal and predicted percentile scores (these are interpolated from the 
norms chart in the manual). The raw scores, without a reference point, are rather 
meaningless anyway so here they are omitted and only standard scores (percentiles) 
employed. 

3. Criterion-referenced scoring-only the f ioentage of students in the school satisfying the 
criterion is included, forcing the readers to think in absolute terms or set their own 
criterion. The n^rmative>referenced thinker could be accommodated by adding the 
percentage of students in the state who satisHed the criterion. 

4. Listing of all the condition variables, how they were measured and how this school 
ranked on them. 

5. Breakdowns of item responses on selected condition variables such as PERLER4T and 
MORESB. 

Exhibit E 

This too, like Exhibit D, is a report for only one school. It includes a narrative portion 

und: 

1. Descriptions of the subscales for each goal. 

2. Percentile rank and predicted percentile rank by goal. 

3. Selected condition variables which might be of particular interest to the audience. Two 
districts reported that the method they used to arouse the interest in what they 
anticipated might be an apathetic faculty was to start with the teacher data in the 
condition variables section. They reasoned that because the teachers had all been involved 
in filling out teacher questionnaires, they could identify most with that portion of the 
report and would be most interested in data about themselves. 

Exhibit F 

These are suggestions as to the kinds of analyses one might go through and some sample 
conclusions one might draw to give as an oral presentation to a faculty. 

The norms chart is an effective visual which can be transferred to a transparency. Here 
when a school score falls at the 30th percentile, one can almost picture the 30 per cent of 
the schools scoring below that point and 70 per cent scoring above. 

Included are examples of the kinds of statements one can abstract from the condition variable 
scores. They are minimally statistical yet communicate the same information. 

Finally, it illustrates how one might use the condition variable information to suggest changes 
in the school. Just as one can look at student performance and devise program changes, an analysis 
of standing on condition variables can suggest school weaknesses; these may, in fact, be more 
amenable to change than student performance. 
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EXHIBIT A 
District Press Release 
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upper Penn Schools Receive State Assessment Results 

Developed verbal skills and readiness to accept change in the world are the two areas in 
which Upper Penn elementary students excel, according to the Pennsylvania Department of 
Hducation. 

Reports were delivered recently by a team from Harrisburg who sat down with the 
administrative team to report the findings of the school assessment program conducted last spring 
in the Upper Penn schools as part of the state's Educational Quality Assessment Program. 

Last March Upper Penn's 5th, 8th, and 1 1th grade students completed lengthy questionnaires 
designed to measure the students', and hence the school's.status on the Ten Goals of Quality 
Education. These goals were formally adopted by the State Board of Education in 1965. They 
endorse the philosophy that the school's purpose goes beyond teaching the 3 R's, that the school 
plays a part in developing a youngster's attitude toward self, toward others, toward school and 
learning in general. Furthermore, the school has a responsibility to develop ui each student desirable 
health habits, creativity, an appreciation of the cultural contributions of others, an awareness 
of the world of work, and the ability to cope with a world of constant change. 

Althougli the results for the elementary schools are based upon replies of 5th graders, they 
aie used to represent the school, not what 5th grade teachers alone have contributed to their 
development. After all, these pupils have been in the school for five years so it is fairer to use 
the results as an assessment of the school. The program is not designed to measure teacher 
effectiveness-what many have called accountability. The results are aggregated for all the 5th 
graders and identification of individual teachers is not permitted by the state plan. 

All replies by students, and teachers who also complete a questionnaire, are anonymous. 
Students remove their names from their answer sheets before turning them in. Why? There are 
at least three reasons: 

1 . Possibly foremost is the desire to avoid placing labels on students-such things as Jan 
Jones has a low self-esteem-'and having such a tag stick with them forever. 



2. Since many questions deal with attitudes, some about the teachers and the school, 
students i;iust feel free to answer truthfully without pressure to respond in a socially 
desirable fashion out of some fear that their teachers will be reading their answers. 

3. Since the purpose of the program is to assess the school, it is not necessary to know 
who said what-only what they said and can do. 

This purpose goes back to 1963 with the original legislation that required the State Board 
of Education to develop a procedure to measure objectively the adequacy of the educational 
programs offered by public schools of the Commonwealth. 



o 
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The assessment service was offered to school districts on a voluntary basis for elementary 
and high schools from 1970 through 1972. In 1973, with the addition of an assessment battery 
for intermediate schools, the evolution was complete. In November 1973, the State Board of 
Education devised a timetable for further participation of schools and to enforce the legislative 
mandate. The resolution stated that in the spring of 1974, 1975 and 1976 one-third of the schools 
m the state will participate so that by fall of 1976 every one of the 505 school districts in 
the state will have assessment reports for its schools. 

Hach school in the district receives its own report. Upper Penn School District-with five 
elementary schools, two junior high schools and the senior high-received eight different reports. 

Typically, the assessment team from PDE pointed out, the individual elementary schools, 
tor example, have differing results.(They further emphasized, that is why the school is the unit 
of analysis und not the district. Were the results to be aggregated for a district, those differences 
among schools would become hidden.) 

Upper Penn is no exception to that rule. The length and complexity of the school reports 
combined with their individual differences make generalizations about the district very difficult. 
The most meaningful analysis comes when the administrators, teachers, parents and even students 
can discuss the results for their school. 

Included in the report for each elementary school are four different kinds of information: 

1. For each of the 10 goals, a comparison of the school scores to all other elementary 
schools in the state. 

2. An expected score range for each goal based upon an analysis of the resources that 
particular elementary school has at its disposal. 

3 The school's relative standing on each of the resources-teachers, students, money, 
community-used to calculate the expected score range. 

4. The number of pupils with a minimum positive attitude in the attitudinal goal areas 
and the number scoring high and low in the cognitive areas such basic skills or knowledge 
of Vocations. 

The results for Upper Peim elementary schools show, overall, verbal scores in basic skills 
to be high, For instance, two of the schools scored in the top 15 per cent of the schools in 
the state, Furthermore, these scores were above the expected scores calculated for those schools. 
That means that even taking into account the possibly more favorable circumstances these schools 
are operating under, they still are scoring higher than schools with similar advantages. 

The elementary schools all scored in the top third of the state in preparation for a changing 
world. Here pupils indicated their degree of comfort and willingness to adjust to new circumstances 
which they might face as societal changes continue or even accelerate. 

In most other goal areas there is a great diversity of scores among the elementary schools. 
However, in all five elementary schools, the mathematics scores are below the verbal scores. 
Morcover, none exceeds its expected score or is in the top half of the state. 

Upper Penn Superintendent of Schools John J. Doe noted that other recent achievement 
test intormation has shown a similar pattern of mathematics scores not matching reading scores. 
According to Dr. Doe, "This additional confirmation has resulted in the creation of a task force 
of principals and teachers from each school meeting to analyze our mathematics program. They 
are looking at textbooks, curriculum, and teaching methods with their recommendations to l)e 
presented to me by December 1st. " 
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John Jdiics, director of curriculum, pointed out: '^n written, narrative report can begin to 
communicate all the valuable insight into our schools we have gained through our particitxition 
in Educational Quality Assessment. " 

Uach school's report will be presented at a series of meetings in January at the respective 
schools. At that time parents and interested citizens will be able to view in more detail the 
report for their schools and have an opportunity for discussion and to asi< questions. 

Educational Quality Assessment reports are not prescriptive. Dr. Doe concluded: "The state 
isn't trying to tell what's right or wrong, good or bad, or what to do now. They do provide 
us with a great deal of information which is the starting point for .self-analysis. We .see some 
strcngihs in our .school programs. We .see some weaknesses. It is our task as a school district 
and as a community to capitalize on our a.s.sets and to overcome our shortcomings. " 



lN*iuivsyivania\*!> Ten Goals of Quality Education 

(Quality (MiiH'ittioii Hliuiilth 

I lf{(>i|) cviM v cliilil iicqiiii r the greateHt poHHible utuIerBtuiMlinj; of himself or herself and 
upiinM'iutioii of hh of her worthiness as u member of Hociety. 

II H<'l|> <Mcry chilli arqiiire understaiiflinji; an<l appreciation of persons belonging to 
i)t\u'v MM'ial, riiltural ami ethnic groups. 

III Help e\ri) cliiM acquire, to the fullest possible extent, mastery of the basic skills in 
the use of wonlrt and numbers. 

IV Hell > every child acquis'c a positive attitude toward the learning process* 

V Help oery child acquire the habits and attitudes associated with responsible citizenship. 

VI Help every chihl acquire good health habits and an understanding of the conditions 
ne<>csMnry for inuiiilainlng of physical and emotional well-being. 

VII iliw every child opportunity and encouragement to be creative in one or more fields 
of endeavor. 

VIII Help e%cr> child understand the opportunities open to him or her to prepare for a 
pcodnciixr life and help each child to take full advantage of these opportunities. 

IX Help every child to understand and appreciate as much as posMible of human achieve* 
niei«l in the natural scienees, the social sciences and the humanities and the arts. 

\ Help e\cry cliitd to prepare for a world of rapid change and unforeseeable demands 
in which contiuniiig education throughout adult life should be a normal expectation. 
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EXHIBIT B 
District Data for Sbhool Board by Percentile 
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UPPER PENN SCHOOL DISTRICT 



GOAL 



SUBSCALES AND DESCRIPTIONS 



I 

Self-Esteem 



Self-confidence: Feelings of success, self-determination, 

attractiveness and self-worth 
Feelings of control over environment: Belief that success in school 

and work depend on effort, not luck 
Relationships with others: Perceived ease in making and keeping 

friends and feelings of acceptance by others 
Self-image in school: Feeling of success in schoolwork, class 

recitation and teacher relationships 



II 

Understanding 
Others 



Race: Comfort when interacting with others of another race 
Religion: Comfort when interacting with others of different religious 
beliefs 

Socioeconomic status: Comfort with others who are richer or poorer 
than self 

Intelligence: Comfort with others of higher or lower ability levels 
Handicap: Comfort when interacting with others who are physically 
handicapped 



III-V 

Basic Skills: 
Verbal 



A 15-minute test of verbal analogies 



III-M 

Basic Skills: 
Math 



A 15-minute test to measure mathematical concepts and 
mathematical computations 



IV 

Interest in School 



Attitude toward learning: Willingness to expend effort to learn and 
valuing the importance of continued learning throughout life 

Attitude toward school: Belief school attendance is important; 
attitude toward school setting,^ teachers and course work 



V 

Citizenship 



Welfare and dignity of others: Concern for feelings of others, 

willingness to protest racial discrimination and to accept new 

people into the group 
Respect for law and authority: Willingness to report lawbreaking, 

to refrain from destructive actions and to obey authorities 

during emergencies 
Responsibility and integrity: Willingness to report own mistakes and 

honoring self-made commitments to group and individuals 
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GOAL 



SUBSCALES AND DESCRIPTIONS 



VI 

Health Habits 



Personal Health: Willingness to follow proper diet, take proper 

medical precautions 
Safety: Restraint from unnecessary risk-taking at home, at school 

and at play 

Drugs: Restraint from improper use of prescription drugs and 
maintaining close contact with others using drugs 



VII 

Creativity 



Visual Arts: Willingness to use own ideas and designs in painting, 

crafts, photography and sculpture 
Performing Arts: Willingness to perform in music, acting, sport or 

modeling 

Science: Willingness to do experiments in social and physical sciences 
and to design or work with mechanical or electronic gadgetry 

Writing: Willingness to produce original written products such as 
poems, jokes, skits, essays and music 



VIII-A 

Vocational 

Attitude 

VIII-K 

Vocational 

Knowledge 



Items measure attitude toward work, career choice and efforts at 
establishing long range educational plans. 



This multiple-choice vocational knowledge test taps understanding 
of skill, training and education requirements of various 
occupations. 



IX 

Appreciating Human 
Accomplishments 



Valuing: Attaching importance to achievement in the arts and 
sciences and the role played by people in these areas 

Receiving: Willingness to learn more about achievements in the arts 
and sciences, and to seek out experiences which provide 
first-hand information on what people in these areas are doing 



Preparing for 
a Chans^g World 



Using effective solutions: Tendency to try solutions reflecting 

positive adjustment to change 
Refraining from ineffective solutions: Tendency to avoid use of 

aggressive or withdrawing reactions in face of change 
Emotional adjustment: Perception of length of the time needed to 

emotionally adjuf t to change 
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EXHIBIT C 
District Data for School Board by Quartile 
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EXHIBIT D 
Detailed Report for 
One School 
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QUALITY EDUCATION 



How is it defined? 
How is it measured? 

The effectiveness of the educational program at Upper Penn Junior High South was assessed 
last March by the Bureau of Planning and Evaluation (Division of Educational Quality Assessment) 
from the Pennsylvania Department of Education. Students in the 8th grade completed an 
Educational Quality Assessment Inventory which measured their development in each of the Ten 
Goab of Quality Education. 

The Educational Quality Assessment Inventory is a collection of paper-and-pencil 
measurement devices serving to appraise attitudes, values, beliefs, habits and basic cognitive skills 
thought to be important in becoming a functioning young citizen of today's world. For more 
thorough interpretation and understanding, information is available concerning the origin of the 
tests used, what they really measure, how accurately and reliably they measure what scores on 
the tests mean, how acceptable scores are determined, and how much influence faking and response 
bias I'ave on the final results. 

Students responded on separate, machine-scorable answer sheets to the inventories designed 
to measure their status, and hence, the school's, on the Ten Goals of Quality Education. Relevant 
background information was supplied separately on the educational level of parents, occupation 
of father, etc. Anonymity for each respondent was maintained. 

Teacher data were also collected anonymously through the use of a questionnaire featuring 
items concerning background, classroom practices, experience, job satisfaction, etc. This teacher 
information supplemented data from students to obtain a profile of the school-to see under 
v^hat kinds of conditions (condition variables) the school is operating which might place restraints 
on what can be accompUsh&d. 

Although a school's standing on a condition variable might be of interest in itself, the primary 
purpose of collecting information was to take into account those differences in schools, 
communities, instructional staff and students in an attempt to provide a fair comparative base 
indicating what a school can accomplish with its pupils. The predicted score ranges and prediction 
hands reported in the general summary present the scores one would predict of our school knowing 
the resources at its disposal. The predicted scores involve no subjective judgment about the school. 
It is based upon a statistical analysis of what other schools are, in fact, able to do with relatively 
similar operating conditions such as socioeconomic status. 



SUMMARY OF PUPIL RESPONSES TO TEN GOALS OF EDUCATION 



Prediction Band 
Percentile 



Actual School 
Percentile 



1. 
II. 

Ul-V. 

III-M. 

IV. 

V. 

VI. 

Vll. 

VIll. 



Self-Esteem 
Understanding Others 
Basic Skills: Verbal 
Basic Skills: Math 
Interest in School 
Citizenship 
Health Habits 
Creativity 

Vocational Knowledge 



39-75 
38-7S 
31-60 
18-50 
34-69 
15-37 
10-44 
52-87 
20-55 



56 
53 
49 
15 
61 
32 
30 
68 
26 
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IX. Appreciating Human Accomplisliments 
X. Preparing for a Changing World 



45-86 
27-71 



76 
79 



SUBSCALES OF TEN GOALS 



The following items subdivide the affective goals to better diagnose areas of strength and 
weakness. Corresponding figures indicate the percentage of students (those responding positively 
to at least half of the total attitude items) who reacted favorably on each subscale. 

Per Cent 

I. SELF-ESTEEM 



Self-Confidence 65 

Feeling of Control Over Environment 76 

Relationships with Others 66 

Self-Image in School 56 

Total Scale 75 



II. UNDERSTANDING OTHERS 

Race 
Religion 

Socioeconomic Status 
Intelligence 
Handicap 
Total Scale 

IV. INTEREST IN SCHOOL 



Attitude Toward Learning 73 

Attitude Toward School 60 

Total Scale 68 

V. CITIZENSHIP 

Welfare and Dignity of Others 34 

Respect for Law and Authority 20 

Responsibility and Integrity 23 

Total Scale 22 

VI. HEALTH HABITS 

Personal Health 32 

Safety 35 

Drugs 57 

Total Scale 35 



70 
67 
87 
76 
76 
86 



27 



SUBSCALES OF TEN GOALS (contliuied) 
VII-A. CREATIVE ATTITUDE 



Visual Arts 79 

Performing Arts 48 

Science 68 

Writing 60 

Total Scale (Attitude) 64 

VIII-A. VOCATIONAL ATTITUDE 87 

IX. HUMAN ACCOMPLISHMENTS 

Valuing 65 

Receiving 3 1 

Total Scale 44 

X. PREPARING FOR A CHANGING WORLD 

Using Effective Solutions 77 

Refraining from Ineffective Solutions 81 

Emotiomd Adjustment 46 

Total Scale 81 
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Educational Quality Assessment 

Spring 1974 
Upper Penn Junior High South 



The table which follows is a condensation of the 24-page Educational Quality Assessment 
report for Upper Penn Junior Higli South. 

Last spring our 8th grade students completed lengthy questionnaires designed to appraise 
their attitudes, values, beliefs, habits and basic cognitive skills thought to be important in becoming 
a functioning young citizen in today's world. 

Two of the scoring comparisons are included in the four-page chart. The first is the percentile 
rank in the state. Here the school score (the average score of our 8th grade students) is-compared 
to other 8th grade schools in tlie state. The 56th percentile score on Goal I, Self-Esteem, says 
that slightly over half the schools in the state (56 per cent, to be exact) had lower scores than 
Upper Penn JHS while 44 per cent had higher scores. 

This score, at the 56th percentile, was within the range expected for a school operating 
under circumstances such as ours. Since schools have vastly differing resources at their disposal, 
one wouldn't reasonably expect a ghetio school's students, coming from broken homes, to achieve 
as liigh a self-esteem score as their more privileged peers in a suburb. Hence, in addition to rank 
in state, a school can compare its student performance to the predicted score which tells us 
how schools operating with resources-money, students, teachers-similar to ours, are able to score. 

Also included in the school report is all the information on the conditions measured which 
are used to construct the profile of the school. Some of this information came from the principal, 
some from teachers and students, and some others gathered yearly by the Department of 
Education. 

Although there are 40 variables gathered which potentially might relate to student 
performance, only a subset of these is used to calculate predicted scores for any given goal. 

Maybe only 10 of these will be used to predict, say. Goal VI. Knowing our standing on 
all of these 10 conditions, EQA can then calculate our predicted scores. They are saying that 
other schools, If operating under these circumstances, would be scoring in this range. 

Some of the more interesting of these 40 conditions are reported on the previous page. 
The percentile rank tells us how we compare to other schools. There Is a numerical scallng~a 
continuum along wliich scores can fall-and our percehdle rank shows where our score places 
us. There is no value judgment intended, i.e., high scores which become higher percentile ranks 
cannot be equated with being good. For example, our average teacher age of 30.77 years places 
us at the 6th percentlle-only six schools out of every 100 In the state have a younger average 
age for their faculty. If our faculty's average age were 60, we'd be at the 99th percentile, but 
no one Is suggesting that is good or ideal or to be strived for. Likewise for all the other variables. 
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In Upper Penn Junior High South of the above district, the school officials may loolt at 
the Health Habits score and conclude that even thougli they scored within their expected score 
range, they are not satisfied with a percentile rank of 30 and turn to the criterion-referenced 
scaling of that instrument for amplification of what contributed to that low score. 

They might conclude; Fewer of our students express desirable habits regarding drugs than 
is true throughout the state. Furthermore, only about one-third of our students express willingness 
to display proper safety and personal health behavior when confronted with unhealthful situations. 

Similar inferences might be drawn from looking at any of the other goal areas and their 
respective subscales. 

Included in each school's report are the data collected to gain information about the school's 
surrounding conditions in order to obtain the profile used to calculate the expected svores. This 
information can provide some interesting clues about one's faculty, school and community. In 
all there are 40 such variables reported. Some of tlie more interesting follow: 

1. Only 15 per cent of the junior high schools in the state iiave a student absentee rate 
as high as ours. 

2. Our average class size of 27.5 compares favorably with the state average. 

3. About two-thirds of the schools spend less per pupil for instruction than we do. 

4. Our faculty is among the youngest in the state; they obviously are also low on experience. 

5. There is a healthy mixture of teachers from the local area, other parts of the state, 
and even out-of-state. 

6. The teachers are satisfied with their working relationship with students and the principal 
but feel relations with both parents and the district administration are in need of 
improvement. 

7. Socioeconomically the area served by the school would be in the middle third of the 
state. 

8. Students find the library very inaccessible. Fewer than half the students report being 
able to use the library as often as they would like. 

9. In only one school in 20 do the students find the guidance counselor less accessible 
than in our school. 

As with presenting any part of the report to the public, a few principles might be followed. 

1. Every number in every report need not be shared with every audience. 

2. Try to find some positive features to balance the negative. 

3. Do not try to bury or ignore the bad news. But try to suggest your concern about 
this finding and what you are doing or plan to do to remedy the situation. 

The data presented above may raise a number of questions or suggest plans of action apart 
from those arising from an analysis of goal scores and student performance. 
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Such ruminations might take the following form: 

1. The faculty in the school is very young and inexperienced; very few have advanced 
degrees. Is this true of our other secondary schools? Are we hiring only young people? 
Is this a deliberate, district policy ,to economize? Or a conscious effort to bring in 
new blood and ideas? In other words, is this occurring accidentally or purposely and 
do we want to continue this policy? 

2. Might the high student absenteeism, the teachers' feelings that parents don't take enough 
interest in their children's schoolwork, and the teachers' dissatisfaction with their 
relationsliips with parents all be related? Is there some way we could better involve 
the parents, teachers, and students? 

3. How is our library currently functioning that so restricts its accessibility to students? 
Can we change library usage policy? Or is this the ammunition we need to at last 
obtain a new library? 

4. Likewise the guidance counselors? Do we need another one or could an aide or secretary 
assume some of the clerical duties that currency burden the counselors and prevent 
their seeing students? 

Typically a school report serves two purposes: 

1. It calls attention to a problem area not previously noted by the staff. 

2. It documents with objective evidence the suspicions harbored by the staff. 

In either case the report can be used to draw attention to previously unheeded request 
for staff, programs, materials, facilities, etc. It can provide an external objective, expert 
assessment of needs. 
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The following guidelines are for the release of Educational Quality 
Assessment results. They will apply to school districts participating in 
the assessment program beginning in 1974. 

The Division of Educational Quality Ar<iessment (EQA) will, on request, 
disclose whether or not a district is in the assessment program beginning 
with 1974 participation. Lists of districts participating in a given 
year will not be published. 



After May I of the year following the report, EQA, using the guidelines 
below, will release any information in the school status profile to an 
interested resident of a school district. Information for a group of 
school districts will not be released to agencies, intermediate units, etc. 



(a) At the tip a of the school report, EQA will suggest to the 
superintendent that the information is public domain and 
should be released to teachers, school board and community. 

(b) EQA will refer interested residents' initial requests for 
data to the local school district superintendent. Superin- 
tendents will be informed that if the request is not honored 
or satisfied at the local level the department will release 
the data. 



(c) Requests for lo^cal school district information not honored, 
or satisfied under (b) above, will require the resident to 
travel to Harrisburg where he or she will be given the 
« information. Mo information will be released over the 

telephone or by mail. 



Please refer all questions to: 



Thomas E. Kendig, Chief 

Division of Educational Quality Assessment 

Bureau of Planning and Evaluation 

Department of Education 

Box 911 

Harrisburg, Pennsylvania 17126 
(7l7)-787-4234 
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Pena»ylvania^H Tea Goals of Quality Education 



Quality Hlueuliou should: 

I Help every child acquire the greatest possible understanding of himself or herself and 
appreciation of his or her worthiness as a member of society. 

II He'p every child acquire understanding and appreciation of persons belonging to 
other social, cultural and ethnic groups. 

III Help every child acquire, to the fullest possible extent^ mastery of the basic skills in 
the use of words and numbers. 

IV Help every child acquire a positive attitude toward the learning process. 

V Help every child acquire the habits and attitudes associated with responsible citizenship. 

VI Help every child acquire good health habits and an understanding of the conditions 
neccMsary for maintaining of physical and emotional well-being. 

VII Give every child opportunity and encouragement to be creative in one or more fields 
of endeavor. 

VIII Help every child understand the opportunities open to him or her to prepare for a 
productive life and help each child to take full advantage of these opportunities. 

IX Help every child to understand and appreciate as much as possible of human achieve* 
nieut in the natural sciences, the social sciences and the humanities and the arts. 

X Help every child to prepare for a world of rapid change and unforeseeable demands 
in which continuing education throughout adult life should be a normal expectation. 
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